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Abstract 


The elderly population aged 65+ years is growing and their ratio to the population aged 
15-64 is expected to reach 4096 by 2030. This implies that those of working age, and, 
subsequently, the overall economy, will face a greater burden in supporting the aging 
population. In addition, the demand and trend is upward for continued independent living. 
As such, there is a growing interest in assisted living technologies that enable self- 
dependent living within homes and residences for the elderly. Remote monitoring 
capabilities, such as detection of falls and small changes in motor functional abilities of the 

elderly, will address the challenges associated with self-dependent living. This talk focuses 
on the radar technology and discusses the time-frequency based nonstationary signal 
processing techniques used to provide the local signal behavior over frequency and to 
detail the changes in the Doppler and micro-Doppler radar signatures over time. Features 
that capture the intrinsic differences in the time-frequency signatures of different gross 
motor activities of the elderly are identified and their performance in human activity 
classification is demonstrated using real data measurements. Offerings of the range 
information, in addition to Doppler, for classifying different motion articulations with 
enhanced reliability are also highlighted. 
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Elderly Population 


e Elderly dependency ratio (Ratio of population aged 65+ to the 
population aged 20-64) 
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Those of working age, and, subsequently, the overall economy, will 
face a greater burden in supporting the aging population 
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Continued Independent Living 


* Provision of independent living to the elderly is a growing area of 
Interest 


* Demand and trend is upward for continued independent living in 
the elderly 


° Independence-assisting technologies that can remotely provide 
capabilities, such as early detection of health deterioration, fall risk 
assessment and fall detection, are in high demand 


* Such technologies can address the challenges of self-dependent 
living in homes and residences for the elderly population 
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Falls in the Elderly Population 


* Approximately 3096 of people over 65 fall each year, and for those 
over 75, the rates are higher! 


* 2096 to 3096 of those who fall suffer injuries that reduce mobility and 
independence and increase the risk of premature death! 


* Falls represent the leading cause of fatal and nonfatal injuries among 
older adults? 


* Direct medical costs for fall-related injuries among people aged 65+ 
was $34 billion in 2013 and could reach $67 billion by 2020? 


* Prompt assistance after a fall can help reduce complications and 
save lives 
!Health Evidence Network. http://www.euro.who.int/  data/assets/pdf file/0018/74700/E82552.pdf 


ŽEnglander Е, Hodson TJ, Terregrossa RA. Economic dimensions of slip and fall injuries. Journal of Forensic Science. 
1996;41(5):733-746. 


*National Council on Aging 
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Fall Monitoring Devices 


* Fall Detectors: Wearable and Non-wearable 
* Wearable devices 
» "Push-button" type or Accelerometer based devices 
o Cannot be activated when loss of consciousness occurs 
» Elderly persons may forget to wear all the time 
* Non-wearable devices 
о Floor vibration sensors, Microphone arrays, cameras 
o High false alarms, privacy concerns 


e Radar is an alternate modality that addresses many of these 
concerns and has proven capability of detecting human motions 
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Radar-Based Motion Detection 


* Doppler frequency enables estimation of radial velocity of a target 


* Rotation and vibration motion of a target or its parts may produce 
periodic Doppler modulations of the received signal 
(Micro-Doppler effect) 


* Micro-Doppler parameters may aid in target classification 


° Doppler repetition period, Doppler amplitude, and initial phase, directly 
indicate specific target characteristics 
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Time-Frequency Distributions 


° Simplest TFD - Spectrogram 
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Micro-Doppler Signature - Falling 
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Micro-Doppler Signatures - Other Motions 
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Experimental Data 





* Doppler Radar with a carrier frequency of 8 GHz 
* Sampling frequency of 1 kHz 


* 5 gifferent test subjects, each repeated the motions 5 times so 
that variations could be monitored for all the activities 
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Feature-Based Approach to Fall Detection 


* Two classes of human activity: Fall and Non-Fall motions 


* Features extracted from suitable signal representations 
° Time-frequency based features 
о Speech processing based features 
o Wavelet transform based features 


° Time-frequency based power burst curve features 
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Time-Frequency Based Features 


Length of 
the event 


Class\Activities 





Maximum Torso Maximum Doppler 
Doppler Frequency Frequency 


ТЕМРГЕ 


UNIVERSITY 





Mel-Frequency Cepstrum Based Features 
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Power Burst Curve 


* Power burst curve represents the summation of signal power 
within a specified frequency band at a given time instant 
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Wavelet Based Features 


9 25 41 8 2 (Reverse biorthogonal wavelet 3.3) 
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Classification Rate 


* Time-frequency based features 
provide the best classification 
results even with smaller training 
sizes 


* Both wavelet and time-frequency 


Classification Rate 


features yield better results 
compared to other features 


e MFCC and PBC methods render 
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—Ó- TFR-based features 

749-Mel-Frequency Cepstrum coefficients (MFCC) 
~©- Wavelet Transform-based features 
—t—Power burst curve (PBC) 
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Performance 


* Best classification rate is provided by the TFR-based 
features 


* False alarms mostly originated due to confusion between 
falling and sitting 


* Micro-Doppler signatures highly dependent on the speed 
of motion 
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Range Information 


Micro-Doppler signatures fail to separate slow falls and fast sitting 


Range spread of the motions plays an important role to remove the 
ambiguity 


Requires use of a pulse-Doppler radar 
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Tri-Domain Signal Representations 


* Tri-domain signal representations 
^  Time-frequency domain (Micro-Doppler signature) 
o Range-time domain 


^  Range-Doppler domain 


Micro-Doppler signature 
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Time-Integrated Range-Doppler Domain 


Time-integrated range-Doppler domain is constituted by 
accumulating consecutive range-Doppler frames 
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Texture-Based Feature Extraction 


* 4-step textural-based algorithm: 
i. Compute gray-level co-occurrence matrix (GLCM) 
ii. Extract 13 Haralick statistical features 
ІП. Select n features that maximize the detection 
iv. Compute the confusion matrix 


Time-integrated 
range-Doppler map 


Statistical 
— >> GLCM Feature — шше —3| Classification 
Computation Selection 
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GLCM 


* GLCM shows how often a gray-level pixel pair occurs in different 
directions 


* Two parameters are required to construct 
° Displacement: d 


о Direction: O 





2]0]0]1 1111319 
Directions 0°, 45°, 90°, and 135° with a distance d =1 
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GLCM 


° Four directions are considered: 0,: 0°, 82: 45°, 83: 90°, 84: 135° 
* Displacement: d4 — 1,4, - 4 
* Sixteen gray levels 


* 8 GLCMs, each of size 16 x 16 


135? [-d -d] 90? [-d 0] 45? [-d d] 
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* Haralick proposed 13 measures of textural features. 


* Typical features derived from GLCM: 


Angular second moment  * 


Contrast ° 
Correlation ° 
Sum of squares: Variance + 
Inverse difference ° 
moment 


Sum average 
Sum variance 


Sum entropy 

Entropy 

Difference variance 
Difference entropy 
Information measure of 
correlation 1 
Information measure of 
correlation 2 


R.M. Haralick, K. Shanmugam, І. Dinstein, “Textural Features for Image Classification", 
IEEE Trans. Systems, Man and Cybernetics, 1973. 
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Feature Selection 


。 Do we need all statistical features to achieve good detection 
performance? 


* Selection of the minimal set of relevant features is important for 
optimizing detection performance 


* Different methods have been proposed 
o> Mutual information 
° Entropy to rank features 
^ Principal component analysis for dimension reduction 


° Sequential forward selection (SFS) 
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Sequential Forward Selection 


* SFS: Heuristic search method 


* Selects the features yielding the highest value of a pre-defined 
objective function: Classification Accuracy 
* Algorithm 
i. Start with an empty set of feature 
ii. Select the next feature, the one that yields the highest 
accuracy when used together with previously selected features 
iii. Update the selected feature set, and move to the next feature 


iv. Repeat steps (ii) and (iii) until total number of desired features 
is selected 


T. Rückstief$, C. Osendorfer, P. van der Smagt, “Sequential feature selection for classification,’ Advances 
in Artificial Intelligence, Lecture Notes in Computer Science, vol. 7106, 2011 
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Sequential Forward Selection 


* Best performance is achieved when three features are selected 
* |nverse difference moment 
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Classification Results 


Accuracy 
| | Detection Rate 
False Alarm Rate 


Micro-Doppler 13 statistical features 88.54 
Range-Doppler 13 statistical features 91.62 
Range-Doppler SFS 3 statistical 95.09 
features 





October 12, 2017 EE500 GRADUATE COLLOQUIUM 


TEMPLE 


UNIVERSITY 





Fall Detection 
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Conclusion 


* Rapid early detection of elderly falls is feasible using radars signal 


* Great application potential in time-critical and privacy-sensitive 
scenarios 


* Reduction of false alarms remains the leading obstacle in final 
developments and marketing of this technology 
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